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1.  Introduction 

Suppose  that  we  are  observing  a  sequence  of  categori¬ 
cal  variables.  Our  problem  addresses  the  matter  of  if 
and  when  a  change  in  the  underlying  cell  probabilities 

has  occurred.  In  other  words,  we  are  trying  to  detect, 
along  the  sequence  a  shift  from  one  multinomial  distribu¬ 
tion  to  another. 

The  literature  to  date  has  discussed  the  case  of  shifts  for 
one-dimensional  observations  (I.e.,  binomial  shifts  In  our 
setting).  Page  [3]  studies  a  cumulative  sum  over  time. 

Chernoff  and  Zacks  [1]  showed  that  a  particular  weighted 
sum  weighing  recent  observations  more  heavily  arises  from 
a  Bayesian  approach.  Kander  and  Zacks  [2]  generalized 
this  result  to  random  variables  whose  distributions  belong 
to  the  one  parameter  exponential  family.  The  latter  two 
articles  develop  the  problem  from  a  hypothesis  testing 
point  of  view.  Sclove  [4]  examines  these  results  in  the 
binomial  case.  We  shall  see  that  the  multidimensional 
problem  is  a  bit  less  tractable.  Sclove  also  suggests 
two  possible  applications.  One  application  is  in  quality 


control  where  one  might  wish  to  detect  whether  a  produc¬ 
tion  process  has  shifted  from  being  "in  control"  to  being 
"out  of  control"  (i.e.,  from  a  low  probability  of  producing 
a  defective  item  to  a  higher  one).  A  second  application 
provides  an  epidemiology  context  where  we  would  be  con¬ 
cerned  with  whether  the  probability  of  contracting  a 
disease  has  changed. 

A  broader  application  is  the  detection  problem.  As 
a  given  field  is  scanned  there  is  a  certain  probability  of 
detecting  an  object  therein.  If  at  some  unknown  time 
point  something  occurs  in  the  field  resulting  in  a  change 
in  the  probability  of  detection  then  we  are  precisely  in 
the  situation  described.  The  first  example  is  easily 
extended  to  a  multinomial  framework  if  the  production 
process  yields  items  manufactured  according  to  specifica¬ 
tion  limits.  We  then  have  three  natural  categories: 

(i)  the  item  is  below  the  lower  specification  limit, 

(ii)  the  item  is  within  the  specification  limits  and 
(III)  the  item  is  above  the  upper  specification  limit. 

The  third  example  is  easily  extended  by  further  elaborating 
the  detection  and  no  detection  classifications.  Yet 
another  example  involves  attempting  to  detect  shifts  in 
political,  sociological  or  psychological  response  over 
time  with  respect  to  categorical  questions. 

In  certain  applications  the  Initial  cell  probabili¬ 
ties  may  be  known,  i.e.,  the  probability  of  a  defective 
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when  the  process  is  in  control  or  the  probability  of 
contracting  a  disease  under  nonepidemic  conditions.  In 
other  applications  no  probabilities  will  be  known.  We 
confine  ourselves  to  this  latter  circumstance. 

In  all  of  our  examples  it  may  be  that  change  occurs 
gradually  over  time.  However  we  will  presume  that  each 
change  is  somewhat  sharp  and  that  the  changed  distribution 
persists  for  a  long  period  of  time  relative  to  the  frequen¬ 
cy  of  observation  before  a  next  change  occurs.  We 
consider  exclusively  the  probability  of  detecting  the 
first  distributional  change.  If  several  distributional 
shifts  may  be  expected  then  subsequent  changes  would  be 
discovered  by  continuous  monitoring  of  the  process  using 
the  procedures  developed  In  the  subsequent  sections. 

The  format  of  the  paper,  then,  is  the  following.  In 
section  2  we  formalize  the  problem  and  developed  weighted 
and  unweighted  cumulative  statistics  and  their  properties. 
In  the  third  section  we  create  one-dimensional  decision 
functions  of  these  statistics  according  to  three  different 
motivations  which  lead  to  the  most  effective  procedure  we 
have  obtained  thus  far.  Finally  in  section  *1  we  examine 
a  portion  of  the  results  of  a  large  simulation  study. 

2.  Preliminaries 

Formally  our  problem  is  the  following.  Vector 
valued  observations  are  taken  with  components  Xjj  , 


J“l,...,r  such  that  X.  Is  distributed  as  a  generalized 

•v1 

binomial  random  variable,  i.e.,  one  multinomial  trial  with 
associated  probability  vector  p  with  components  p.,p_,...,p 
for  i-l,...,k  while  is  distributed  as  a  generalized 
binomial  random  variable  with  associated  probability 

*  t  » 

vector  p  with  components  p.,...,p  for  i-k+l,k+2 . 

*  » 

The  vectors  p  and  p  are  assumed  unknown  along  with 
the  change  point  k  which  is  to  be  estimated. 

At  any  given  trial  t  let  us  define  the  following 
statistics 


U)  S<*>  -  i  X.. 

W-m+1  1J 


J“1  »2 , . . .  ,r 


( i ) 

Trn  i  "  T-  (m+i-f  )X.  , «  , 
m’J  W-m+1  1+1 


Let  and  be  rxl  vectors  whose  components  are 


,m 


.m 


the  S^}  and  respectively. 

m,j  m,J 

The  S  statistic,  for  a  given  .1,  is  Just  an  unweighted 
sum  or  the  last  m  Xjj’s  up  to  and  including  X^j .  The  T 
statistic  for  a  given  J  is  a  weighted  sum  of  the  last 


m  Xjj's  with  greater  weight  attached  to  the  latter  obser¬ 
vations.  Over  Increasing  t  and  T^^  will  be  ref^rre 

<vm 

to  an  unweighted  and  weighted  moving  sums  respectively. 


The  and  T^  may  be  examined  directly  over  l  to 

<\,m 

uncover  evidence  of  a  distributional  change.  If  for  a 

•  (f) 

given  J  p.<p,  then  S  .  ought  to  increase  after  the 

J  J  m  9  J 

change  point  and  even  more  so.  A  similar  statement 

m » j 


i  (4) 

holds  when  p,>p..  In  fact  such  examination  of  the  Sm 

and  may  be  helpful  in  confirming  shifts  suggested 

A.m 

by  the  approaches  presented  in  section  3.  Of  course,  by 
themselves  they  hardly  constitute  a  precisely  defined 
procedure. 

However  the  intuition  incorporated  into  these  statis¬ 
tics  argues  that  we  should  examine  the  X.'s  in  blocks 

'V1 

sequentially  and  likely  with  overlap.  Of  course  to  be 
able  to  effectively  detect  a  change  point  we  must  assume 
that  k  Is  large  with  respect  to  the  block  size  m.  In 


selecting  m  we  face  a  trade  off.  Use  of  a  large  m  reduces 
noise,  i.e.,  achieves  stability  of  our  and 

'V  'V 

vectors  under  no  distributional  shift  while  use  of  a  small 


m  makes  the  moving  average  more  responsive  to  the  incidence 
of  such  a  shift.  In  addition,  the  choice  of  m  must  depend 
(in  an  obviously  monotonic  Increasing  fashion)  on  the 
known  number  of  categories,  r.  If  m  is  too  small  relative 
to  r,  many  of  the  cell  frequencies  will  be  zero,  i.e., 
many  of  the  components  of  and  will  be  zero 

regardless  of  whether  or  not  a  change  has  occurred.  The 
only  shifts  we  could  hope  to  detect  would  be  in  the  most 
probable  categories  thereby  essentially  degenerating  the 
problem  to  a  binomial  case. 
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The 


How  do  we  Justify  the  use  of  S  and  \ 

n  m  m 

(t)  ^  ^ 

S  ,  arise  rather  naturally.  They  are  the  raw  cell  frequen 

m,J 

cies.  Cumulation  is  suggested  by  a  variety  of  asymptotic 

considerations.  The  T  .  are  less  intuitive.  A  more 

m,J 

general  weighted  moving  sura  would  be  of  the  form 


l-l 
2  c 
i“£-m+l 


(m »■£ » i j 


The  selection  of  c(m,£,i)  =  m+i-£  develops  as  follows. 
For  the  one-dimensional  problem  in  the  exponential  family 
Kander  and  Zacks  showed  that  for  testing  a  single  change 
in  the  mean  (2)  i3  Bayes  against  a  uniform  prior  on  the 
time  of  change.  Let  us  consider  thl3  approach  in  our 
multidimensional  situation. 

We  suppress  l  and  consider  a  fixed  sequence  of  m 
observations.  We  wish  to  test  the  hypothesis  of  no 
distributional  change  across  the  m  observations  against 
the  alternative  of  a  single  change.  We  have  independent 
~  GB(p^ ) ,  1-1, ...,m  with 

•V  'u 
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Since  k  is  unknown  we  will  suppose  k  is  random, 
distributed  according  to  r(k),  k-1  ,2  , . . .  ,m-l.  We  will 
specialize  t  to  the  discrete  uniform  later.  The  conditional 
distribution  of  the  sample  given  k  is 


k  r  x.,  m  r  ,x. 


f (xn , . . . ,xm|k)  -  n  n  p,  ^  n  n  p<  ^ 


i-1  J-l  J  i-k+1  3-1  J 


r  ^k  1  r  *®m  1~^k  1 

n  p.  K,J  n  p.  . 

j-l  J  3-1  J 


Thus  the  unconditional  distribution  of  the  sample  is 


ra-1  r  Sv  m  r  ,sm  ,-s,,  * 

(3)  f(x,  -  £  n  p.  n  p  K>Jx(k). 

•v1  v"  k-1  J-l  J  J-l  J 


Consider  g(p)  such  that  g  0  (p)  «  exists  on 
^  «v  3pJ 


[0,1],  J-l,...,r.  Let  Pj  *  Pj+6j.  We  thus  have  as 

11*11-0 


g(p  )  £  g(p)  +  z  g(J  ^ (p)6. . 

0/  'V  J 


In  particular  with  g(p)  -  Z  log  p^ 
*  r 

(4)  g(p  )  £  £  c.  log  p. 

•v  J-l  3  3 


AootssiooToF' 


VTI6  ORiAAI 
DOC  TAB 
Ifcaiciou-'icod 
JuiUf  icr.tion 


+  i  flit. 


Br_ 


J-l  PJ 


_Dl3trl*;utifn/ 


'  1  ».y -JT.r  ’• 


Rewriting  (3)  as 


A'. all  a;iu/ci' 
( Di 3 1  special 


& 
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f  (X, 

•V, 


E  sk  1 
m-1  j-l  K>J 

,x  )=*  E  x(k)‘e 

k=l 


log  Pj 


+ 


E  (S  ,-S.  . 

j  — ^  ^  >  J  k ,  J 


i 

Hog  Pj 


and  using  (*0  on  the  last  summation  yields 


m-1  j- 

f(x,,...,x  )£  E  t (k)e 
#\,ra  k*l 


Sk  H0S  P-t"*1  ^  ^  -t  Hog  P* 

1  K>J  J  -Jal  m»J  >  »J  J 


r 


+  E  (S 

J-l 


mj 


>VPJ 


E  Sm  1 
m-1  J-l  m»J 
y  E  t (k)e 
k-1 


r 

log  Pi+  E  (S 
J  J-l 


>VPJ 


Under  the  null  hypothesis 

r 


f  Cx^  > . 


J 


E  S 
=1 


m,J 


log  P3 


e 


so  that  the  likelihood  ratio  A(x, ,...,x  )  becomes 

-J" 


m-1  j-l 

(5)  A  (x,  , . . .  ,x  )  *  E  r(k)e 
v1  *\,m 


E  <sn.  rS,  «)««/p 


m.J  kJ'^J 


c  >6i/p. 

Again  as  ||5||-^0  e  J  J  Jj-l+c,6./p.  so  that  (5) 

^  J  J  J 

becomes.  Ignoring  terms  involving  6  *6. 

J  1  J  2 
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4*1 - -X.  X 

X(x1,...,xm)  $  kf1T(k)jf1(Sm,J-Sk,j)5j/Pj+1 


If  we  now  let  x(k)  =.l/(m-l)  and  Interchange  the  order 
of  summation  we  obtain 


r  6.  m-1 


A.  V  •  Ill— J. 

X(x,  ,.  . .  ,x  )  =*  — r-  E  I  (S  ,-S,  ,)+l 

•v1  •V.”  ”’-1  J-l  P.1  k-1  m>J  “>•> 


1  F  6.1 

E  T  4+l. 
m-1  j=1  Pj  m,J 


Thus  a  distributional  shift  would  be  Indicated  by 
large  values  of 


E  % 
j-lPJ  m'J 


If  p  and  p  were  known  (6)  could  be  used  directly 

<v,  O. 

and  would  provide  the  Bayes  test  statistic.  With  p  and  p 

<v  <v 

unknown,  some  6j  will  be  positive,  some  negative  and 

some  zero  but  the  given  linear  combination  of  the  T  .  is 

m,J 

not  computable.  The  6j  and  Pj  can  be  estimated  from  the 
sample.  (We  shall  examine  this  point  later.)  However  this 
would  necessitate  making  2(r~l)  estimates  from  m  observa¬ 
tions  and  will  provide  hopelessly  unstable  estimators. 

Hence  the  most  we  can  conclude  at  the  moment  is  that  the 

T  ,  seem  to  be  appropriate  weighted  averages  to  study 
m ,  j 

over  time  but  exactly  how  to  combine  them  into  a 
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one-dimensional  test  statistic  remains  to  be  discussed. 


In  concluding  this  section  let  us  examine  the  behavior 

of  S  and  T  .  We  will  continue  to  suppress  t  for  the 
„  m  .  m 

•\j 

remainder  of  this  section. 

r 

Note  that  Z  .  53  m  and  thus  as  we  proceed  over 
j=*l 

time,  some  S„.  .  will  increase  while  others  decrease  but 
their  sum,  at  any  fixed  time  is  m.  Moreover  if  we  con¬ 
tinue  to  assume  a  uniform  distribution  for  the  change 
point 


(7) 


E<Sm,J  )  -  E<E<s.n,J|k,) 


,  m-1  m 

H  EE(I  xiJlc) 

k-1  1-1  1J 


m-1 


kE1(kV(m-k)pj) 


^(Pj+Pj  ) 


which  equals  mpj  under  no  change. 

var  (S  .)  =  var(E(S  . |k) )+E(var (S  Jk)) 
m , J  m  ,j  '  m , j 

t 

=  var(kpj+(m-k)pj )+E(var( 


1  X, . |k)) 
1  =  1 


=  (Pj-Pj )2var(k)+E(k  Pj (1-Pj )+(m-k)Pj (1-pj ) ) 


m(122)  +  2(pj (1“pj )+pJ (1-pj ^ 

which  equals  m  p^Cl-pj)  under  no  change. 

In  fact  a  similar  calculation  on  the  individual 
observations  shows  that  is  a  single  Bernoulli  trial  { 

with  success  probability 


(8) 


IJ 


(l-l)Pj  +  (m-i)p 


m-1 


1 


Hence  the  exact  distribution  of  S  .  is  that  of  the 
sum  of  m  independent  but  non-identically  distributed 
Bernoulli  random  variables.  Under  the  null  hypothesis  it  is, 
of  course,  Bl(m,Pj).  Moreover  from  (8)  the  moments  of 
X^  can  be  readily  computed  although  the  expressions  become 
rather  unwieldy.  In  particular  we  can  show  that 


[  I  EUjj  -  ECX^))2]172 

[  ?  EClXy  -  ex±j  | 3 ) 31/3 


). 


Thus  Liapunov’s  theorem  insures  that  S  .  is 
asymptotically  normal  under  either  hypothesis. 


1 


Turning  to  we  note  that  upon  interchanging  order 


of  summation 


m(m-l) 

2 


Thus  as  with  S  as  we  proceed  over  time,  some  T 
will  increase  while  others  will  decrease  but  their  sum  at 
any  fixed  time  is  .  Similarly  we  may  show  that 


which  becomes  — Pj  under  no  change.  Furthermore 


var (T  , ) 


m  p  m  p 

tV  w  xm,j  *  1f2<1-1)pij(1-pij)- 


This  is  a  rather  messy  expression  which  obviously 

reduces  to  ^  pj(l-pj)  under  no  change. 

Liapunov's  theorem  again  insures  that  T  .  is  asymptotically 

™  >  J 

normal.  Kander  and  Zacks  develop  this  result  for  the 
more  general  exponential  family  case  and  also  discuss  the 
rate  of  convergence.  They  briefly  consider  the  exact 
distribution  of  T  .  in  a  scaled  binomial  case  (p.  1202). 

in  >  J 

The  expressions  in  (7)  and  (9)  enable  us  to  construct 

I 

method  of  moments  type  estimatorsof  pj ,  Pj  (and  6,  if 
desired) ,  i.e. , 


m(2m-l) 

6  “m>  1 


S_  ,  -  5? 


m  (m+1 ) 
12 


2(2m-l)S 


m,J 


-  6T 


HuL 


m(m+l ) 


51  tn  m(m»2)o 

2  m  ,3  ~  6  m,J 

m2(m+l) 

12 


6T  -  2(m-2)S  . 

m(m+l) 


and 


~  12T  -  6 (m-1 ) S_ 

5  a  _ m.iJ 


m 


(m+1) 


All  of  these  estimators  are  unbiased.  However  since 


m 


m 


COV(Tn-,J>  Sn,,J>  -  rar(XlJ>  ■  ^d-DPija-Pij) 


none  of  these  estimators  13  consistent.  All  three  have 

variance  of  order  m.  Thus  effective  estimation  of  the 

coefficients  of  the  T  .  In  (6)  Is  revealed  to  be  hopeless 

m 

unless  the  change  point  Is  known. 


3 .  The  Methods 

We  now  consider  a  variety  of  procedures  which  suggest 
themselves  as  plausible  methods  for  detecting  a  distribu¬ 
tional  shift.  These  methods  may  be  loosely  classified 
under  three  headings  —  (i)  Law  of  Large  Numbers  type 
approaches,  (ii)  Departures  from  centrality  type 
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approaches  and  (iii)  Tests  of  Homogeneity  type  approaches 
We  defer  comparisons  and  criticisms  of  these  approaches 
to  the  next  section. 

3.1  "Law  of  Large  Numbers1'  Approaches 
Consider  the  absolute  difference 


is, 


U) 


s ) | 
m  J  1 


,X£J  "  X£-mJ 


and  define 


(10) 


Note  that 


Q 


U)  m  y  |~(0  Al-1) 

n  J-l  m’J  " 


0  X*,J  “X*Hn,r  J-1' 


otherwise 


and  thus 


'm 


m 


if 

l<_ k 

■  0 )  «  ■ 

£pjpj 

if 

k<£  <k+m 

'  2 
Epj 

if 

£>k+m 

-  2)  =  : 

L  -  p'«m 

H 

O 

* 

Hence 

-U- 


2(1  - 

V; 

if 

£<k 

E(Q  CD)  -  • 
m 

2(1  - 

£pjpj) 

if 

k<f<k+m 

2(1— 

9  ? 

Epj  > 

if 

l  >k+m 

£<k 

k<£<k+ra 

•£>k+m. 


var(Q  (£) ) 
m 


4  IPj  (1  -  Ep  2) 

4  IPjpjd  -  IPjpj) 
4  ZPj^(l  -  EPj  ) 


if 

if 

if 


Similarly,  consider  the  absolute  difference 


T(t)  _  TU-1) 

3 

ro » J  ® ,  J 

l-l  1-2 

E  (m+i-£)X.  ,  E  (m+i-£+l )X* , ,  - 

i-f-m+1  1+1  i^-m  1+1 


SU) 


Hence 


(Z)  _  U- 1) 
m ,  J  m ,  J 


m-S 


U) 

m,j 


lf  xt,r0 


and  thu3 
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p/|TU)  TU-1) 

P(|m,j  "  AmJ 


s'lh 

m  J 


1-p.  if  £<k 


1-P, 


if  l>  k 


and  P(|T**j  -  T^"1)|  *  m-S<*})  -  1  -  P(  |-S^{ ) 

m }  J  in  j  j  m,J  m  j  j  in  ^  j  m  j  j 


Define 


(ID 


R  (l)  -  Z  -  T^T1^ 

m  jal'  mj  m,J 


Then 


Rm(0 

m 


m  -  S 


U) 

raj, 


z  s_<*> 


J^l 


mj  » 


if  X.  .  -1 
,Jo 


2(m  -  S^.}  ) 

mJQ 


if 


X  -1. 

c,Jo 


U) 


Hence  0<R  (l)< 2(ra-l)  since  S'  ,  >X,  .  *1  and  R _(£)  takes 
—  m  —  ra  —  L  m 


on  values  0 ,2 , . . . ,2(m-l ) .  Furthermore  for  a»0 ,1 ,2 , . . . ,m-l 


P(R  (f )*2a)  -  Z  P (R 

m  j,l  m 


U) 


2a,  »  1) 


l  Pts^l  -  m-a,  X,  ,  -  1) 
m  J  tj 


J 


Z  PCS*4:1}  -  m-l-a )  P(X.  .  =  1)  • 
ra-l  ,j 


-16 


(l-l ) 

The  distribution  of  S'  .  :  was  discussed  in  the  previ- 

m-1 ,  J 

ous  section  under  a  uniform  distribution  over  the  change 


point  k.  For  the  present  k  is 

fixed  so  that  if  £<k+l. 

Sra-lJ  *  B1<m_1,Pj)* 

If  £>k+m 

Sm-Ij  '  ^ 

k+l<f <k+ra,  S^l1]  -  W1  ♦  W2  where  and  W2  are  Independent 

with  ~  Bi(m+k-f,Pj 

, )  and  W2  * 

Bi(£-l-k,  p j  ) .  Of  course 

P(X^  j=*l)  ■  Pj  if  £<k  and  -  pj 

if  £>k .  Let 

m-1 

£<k+l 

I 

H 

c 

m+k-f 

k+l<£<k+m 

0 

£>k+m 

1 

0 

f  <k+l 

n2U)  ■  \ 

l-l-k 

k+l<£<k+m 

1 

m-1 

L  >k+m 

and 


m-a-1  n .(£)  1  n, (4)-i  n_(£) 

Y(m,f,a,J)«  I  (  1  )p,  (1-p.)  (  ) 

i-0  i  J  J 


m-a-1 -i 


,m-a-l-i  ,  n0(l )-(m-a-l-i) 
Pj  U-Pj) 

with  (J)  ■  0  if  c<d  and  (°)  =  1.  Then 
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r 

E  Y(m,£,a,j  )p,  if  l<_ k 

J-l  J 

P(R  U)  =  2a)  -  • 
m 

r  t 

E  y(m,i,aj  )p.  if  i>  k. 

j-l  J 

Despite  the  awkwardness  of  the  distribution  of  R  (£) 

m 

its  mean  and  variance  are  not  that  difficult  to  compute. 
Prom  the  argument  after  expression  (11) 


E  E[2(m-S^h  |X 
j-l  m’J 


*.j"l3pJ 


E(R  U)) 
m 


if  l<_  k 


if  l>  k 


e  2[m-i-E(si!;t:1,)]p, 

IT1”  X  >  J  J 


I  2[m-l-E( 

j-i 


o(£-l) 

°m-l,J 


if  l<k 


if  l>  k 


l<k 

k+l</<k+m 
l  >k+m 
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2<m-l)(l-£pJ2)  if  l<k 

-  2(m+k-i)a-rPjpj  )  +  2U-l-k)(l-Zpj2) 

if  k+l<£<k+m 
2(m-l) (1-Epj2)  if  l> k+m. 

Similarly  we  may  obtain  the  variance  of  R,(£)  by 
computing 


E(R  2(f )) 
m 


if 

if 


l±k 

^>k 


■.JiPjE(n,-l-s«-l]>2, 

-.j^EOn-X-S^^j)2, 


if  £<k 


if  £>k 


From  previous  discussion  we  know  the  mean  and  variance 

of  si1:1]  so  that 
m—  1 , J 
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4  Z  [ (m-1 )Pj  (1-Pj )  +  (m-l )" (1-Pj )"Pj ] 
If  l<  k 


E(R  2(0)  a  ■  4  Z  p.[ (m+k-£)p. (1-p, )+(£-l-k)p. (1-p, ) 

m  1,1  J  JJ  J  J 


+((m+k-^)(l-pj )+(£-l-k)(l-Pj ))2] 


if  k+l<£<k+m 


4  Z  [(m-l)pj2(l-pj)+(m-l)2(l-pj )2Pj] 

J  ^ 

if  £>k+m. 


Subtracting  (E(Rm(£)))  and  simplifying  yields 


4  (m-1 )  Zpj  2  (1-pj  )+4 (m-1 ) 2 ( Epj  2-  ( EPj  2  ) 2  ) 


if  l<  k 


var(R  (l) ) 
m 


4(m+k-e)EpjPj (1-pj )+4 (£-l-k)EPj 
+4(m+k-£)2(EpjPJ2-(EpJpj )2) 

+4(£-l-k)2(EPj3-(Epj2)2) 

+4  (m+k-f  )U-  1-k )  ( EPj  Pj  2-EPj  pj  Epj  2 ) 


if  k+l<£<k+m 


4 (m-1 ) EP j  2 (1-P  j )+4(m-l)2(Epj3-(Epj2)2) 
if  £>k+m. 


I 


How  may  we  employ  (10)  and  (11)  to  develop  detection 
procedures.  Note  that 


E(1  - 


Q  U) 


m 


-)  =  E  (1  - 


R  U) 


m 


v  2 

Zpj 

if 

l<k 

1 2 
EPJ 

if 

f.>k+m 

and 


QmU) 

E(1 - g - )  *  EPjPj 


if  k+l<£<k+m 


R_(£)  (m+k-£) Zp. p .  +  (£-l-k) Ip ' ' 

E  (1  -  57-;  ,t)  =  - i-X - 1 

2(m-l)/  m-1 


if  k+l<^<k+m. 

It  is  also  apparent  that 

R  d)  Qmd) 

var(l  -  <  var(l - - — )  for  £<k 

and  for  £>k+m 

i .  e . ,  for  £<_k 

[£Pj2U  -  zPj2)]  -  Ci5irEpJ2(i-pJ )+EPj3-(rP;)2)23 

■  <Ipj2  -  V><S>  1  0 

with  a  similar  argument  for  £>k+m. 

Furthermore  the  Cauchy-Schwarz  inequality  assures 


that 


i.e.  , 


r-Pjpj  lhp3W} 


r-PjPj  £  niax(Epj2,Zpj2) 


so  that  we  must  have  one  of  the  following 

'2 


(i) 

Epjpj  i  Ep/ 

<_  Ip 

(11) 

Epjpj  i  Epj2 

Ip 

(111) 

Epj2  i  Epjpj 

<  Ip 

(lv) 

Epj2  -  Eplpj 

<  Ip 

Q _U)  R _U) 

Thus  if  we  were  to  monitor  1  -  — ^ —  or  1  -  g  ('m~ ~i~)' 

over  l ,  and  observe  a  fairly  steady  Increase  (case  (ill)), 
a  fairly  steady  decrease  (case  (iv)),  or  a  fairly  well 
defined  "v",  i.e.,  decrease  and  then  increase  (cases  (i) 
and  ( i 1 ) )  this  would  provide  evidence  of  a  distributional 
shift . 

Since  the  Qm(£)  and  R[n(£)  may  be  expected  to  be  rather 
unstable  let  us  average  them  in  blocks  of  m  and  define 


(12) 


Wi  U)  =  ~ 
1  m 


l 
I 

i=£-m+l 


Q„(i) 


(1  -  - 


m 


2 


-) 


(13) 


»mo  =  ^ 

/  m 


( 

I 


R  ( 1  ) 

(1  - 


(Note  that  and  W2  can  not  be  computed  sooner  than  £=»2ra). 
For  £<k,  and  are  both  unbiased  estimators  of 

p 

ZPj  and  for  £<k+2m,  and  W2  are  both  unbiased  estimators 
»  2 

of  Zpj  .  Again  in  the  presence  of  a  distributional  change, 
a  perturbation  of  and  W2  across  k  to  k+2m  should  be 
observed.  Although  the  preceding  variance  calculations 
might  suggest  that  var(W2)  <  varCW^)  this  is  not  necessarily 
so  since  is  an  average  of  independent  random  variables 
(see  after  (10))  while  W2  is  an  average  of  dependent 
variables  (see  after  (11)).  While  a  computation  of  var(W^) 
and  var(W2)  could  be  attempted  based  on  previous  calculations 
the  results  would  be  hopeless  to  compare.  However  since  the 
Rm(i)  are  positively  correlated  one  might  suspect  that  the 
inequality  would  be  reversed.  In  fact  our  simulation 
study  in  the  next  section  reveals  that  this  is  not  so, 
i.e.,  var(W2)  tends  to  be  much  smaller  than  var(W^). 

In  the  binomial  case  with  being  the  result  of  £th 
Bernoulli  trial  we  have 


V*>  =  E  !xi  -  xi_ml 

1  i=£-m+l  1  1  m 


.  I  i 

W9U)  =  m  -  Z  |mX,  -  Z  X  I 

2  m~1  W-m+1  1  r-l-m+1  r 


In  order  to  formulate  an  estimator  of  k  based  on 

either  or  V.’2>  if  a  disturbance  is  observed  commencing 

at  approximately  trial  l  and  stabilizing  after  approxi- 

mately  trial  £  +2m  then  k  =  £  . 

'  o  o 
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Consider 


(14)  w3U) 


r 

I 

j=l 


(S 


U) 

m  J 


m  .  2 
r ' 


1  (S 

j=l 


U),  2 


2. 

-  m  /r 


(15)  W.U)  =  I  (T^£)  -  -^vgi:>)2  -  I  (T^~1})2  - 

(Note  that  and  can  not  be  computed  any  sooner  than 
£=m) . 

If  £<k,  VU  and  Indicate  "how  far"  the  distribution 
p  is  from  the  equiprobable  cell  distribution  and  if 
£>k+m  they  indicate  "how  far"  p  is  from  the  equiprobable 

'V, 

cell  distribution.  As  £  increases  from  below  k  to  above 
k+m  we  ought  to  be  able  to  observe  a  change  from  a  fairly 
stable  "distance"  to  instability  and  back  again  to  a 
fairly  stable  "distance".  More  precisely 


E(W 3U) ) 


t  T,(oU  K2  2. 

I  MS  ,)  -  m  /r 

J»1 


2  2 

m(m-l)Epj  +m-m  /r 


if 


£<k 


(k+m-£ ) ( k+m-£-l ) Ip . 2+ (£- k ) (£-k-l ) Ep ! 2 

J  J 

+m+2 (k+m-C ) ( £-k ) Ep  ^  p^ -m2/r 


m(m-l )  Ep . 2+m-m2/r 
J 


if 

if 


k+l<_£<k+m 
i >k+m . 
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These  may  be  written  a  bit  inure  suggest  Ively  as 

m2Z(pj-l/r)‘°+m(l-}:pj 2 )  if  £<k 

r  '  a 

l  [ (k+m-£) (p  -l/r)+(£-k) (p  -1/r)  ] 

J=1  J  J 

+  (k+m-£ ) ( 1 - 1 p  2 )  +  ( l~k ) ( 1 - £p j 2 ) 

if  k+l<£<k+m 

m2E(Pj-l/r)2+m(l-Zpj2)  if  £>k+m. 

While  the  second  set  of  expressions  suggests  that 

departure  from  the  center  of  the  r  dimensional  simplex  is 

being  measured,  the  first  set  of  expressions  reveals  that 

2 

E(W3)  is  merely  of  the  form  a(m)£pj  +b(m)  for  £<k  and  of 
*  2 

the  form  a(m)£pj  +b(m)  for  £> k+m.  Thus  monitoring  over 
Z  is  much  like  studying  or  from  the  previous  sec¬ 
tion:  under  a  distributional  change  a  departure  from  relative 

stability  will  hopefully  be  observed  across  trials  k  to 
k+m  and  then  a  return  to  relative  stability.  All  of  these 
remarks  are  appropriate  for  .  In  particular,  although 

the  expressions  are  a  bit  more  complicated  it  may  readily 

2 

be  seen  that  E(W^)  is  of  the  form  c(m)£pj  +d(m)  for 

'  ? 

l<k  and  of  the  form  c(m)5Jpj  +d(in)  for  f>k+m. 

An  argument  which  ’ends  Further  support  to  W.^  is 

the  following.  If  t<  k  then  the  set  {  ,  .  .  . /Vi^r-l  *  13 

a  complete  and  sufficient  statistic  for  th**  most  recent 


sample  of  m  observations.  It  is  apparent  that 


U) 


s^>  ,  )  - 


l  s[1}  -  1) 


H (S  i  j  “  — rr — rx  *•  £>  . 

m,.,...,  m,r-l  m(m-l)  ^  m,j  m,j 

1  (&)  2  1 

=  /  — -t t  E(S'  i)  -  is  the  uniformly  minimum  variance 

m(ra-l ;  m,J  m-i 

2 

unbiased  estimator  of  Ipj  .  Similarly,  if  £>_k+m  H  is 
» 2 

the  UMVU  of  Epj  .  Furthermore  H  and  are  linearly 

related.  Thus  will  be  as  effective  an  index  for  our 

purposes  as  H  and  may  be  used  equivalently.  We  comment 

that  since  W-^  and  are  computed  on  the  basis  of  a 

sample  of  2m  their  use  is  not  discouraged  by  the  above. 

In  concluding  this  subsection  we  develop  a  statistic 

similar  to  W,  and  Uh  which  is  a  function  of  both  and 

j  4  m 

.  Analogously  to  prior  calculations  we  have 


E  (S 


U) 


) 


mp. 

■  (m+k-£)pj+(£-k)pj 

mpj 


if  l<_ k 

If  k+l<£<k+m 

if  k>l+m 


and 


E(T 


U) 


) 


m(m-l )_ 

—2 - Pj 

(m+k-£ ) (m+k-£-l )_  ,/ 

2  Pj  +  I 


m(m-l)  ' 
~2 - Pj 


if 

m(m-l ) 
2 

if 

if 


£<k 

(m+k-£) (m+k-£-l )  ' 

2  Pj 

k+l<£<k+m 

£>k+m 


so  that 
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E(tJ*}  -  '  H*-"-1—  S<*>)  =  0 
m,j  2  m,J 


If  L< k,  £>k+m 


_  (m+k-£) (d-k) ,  •  . 

- 2 


if 


k+l<£<k+m» 


Since  I  (T 

J»1 


U)  _  .  0  for  all  f  »  are  led  to 


(16) 


WgU) 


r 

E  (T, 
J-l 


U) 


(m-l)qUK2 


(Note  that  W-  can't  be  computed  sooner  than  £- m.) 

The  behavior  of  W,-  should  be  3uch  that  below  k  and 
above  k+m  it  will  be  small  and  between  k  and  k+m  it  will 
tend  to  be  larger. 

In  the  interest  of  computing  E(W^)  we  express  (16) 
as 


v  l  m  ,  0 

w At)  =  2  (  Z 

0  J-l  W-m+1 


Thus 


r  l  _  ,  ~ 

E(W Al))  =  Z  E[  Z  (~Ui -l)x.,r 
5  J-l  i-d-m+1  * 


-  I  [ var(  Z  (^H-OX,.) 
J-l  i=£-m+l  '■ 


+  (E(  Z  (^~H-d)X.  .  ))2] 
i-£-m«-l  *  1J 
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r  i  0 

l  [  E  (™=i+1_^)‘;p  (1-p  ) 
j=l  i=£-m+l  *  J  J 


+  (  E  )2]  if  ^<k 


l=£-m+l 


E  [  E  (^i+i-£)2p.(l-p.) 
J=»l  l»£-m+l  J  J 


+  Z  (5^H-£)2p!(l-p‘) 
i=*k+l  *  J  J 


+  (  E  (^S=i+i-^)p  +  E  +1— £)p!  )2] 

i=£-m+l  *  J  i=k+l  *  J 


if  k+l<£<k+m 


**  ^  m— 1  2  *  * 

E  [  E  (5^i-£)2p,  (1-p,  ) 

J»1  i=*£-m+l  J  J 


+  (  E  (2=i+i-Op!)2]  if  £>k+m 

W-m+1  2  J 


Although  these  expressions  may  be  simplified  somewhat 
it  is  more  crucial  to  note  that  again  E(W,-)  is  of  the  form 
e (m) Epj 2+f (m)  for  £<k  and  of  the  form  e(m)Epj2+f (m)  for 
£>k+m.  Thus  may  be  monitored  over  l  as  our  intuition 
suggests  and  analogous  to  and  . 
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In  the  binomial  case  our  expressions  for  and 


W »-  reduce  to 
o 


itk  2 


W -.(£)  =  2(  E  X.  -  %) 
3  i=e-m+l  1 


£-1 

Wu(£)  =  2(  E  (m+i-£)X, -  ™iE=±l)2 
4  i=£-m+l  1+1  M 

W RU)  =»  2(  E  (!!^-ti-e)X.  )2. 

3  I=*£-m+l  2  1 

As  at  the  end  of  section  3.1,  k=£Q  provides  an 
estimator  of  k. 

3.3  "Test  of  Homogeneity"  approaches. 

A  test  of  homogeneity  seems  to  quite  naturally  suggest 
itself  for  thi3  sort  of  problem.  We  are  trying  to  detect 
for  a  collection  of  observations  whether  one  multinomial 
distribution  Is  generating  them  or  whether  two  different 
multinomials  are  generating  them.  Discovering  which  of 
these  two  hypotheses  Is  true  is  precisely  the  raison  d'etre 
for  chi-square  based  test  of  homogeneity  statistics. 

However  in  our  present  circumstance  where  we  have  a 
continuing  sequence  of  observations  there  is  certainly 
no  unique  choice  of  partitioning  into  groups  to  establish 
comparisons.  However  since  we  postulate  but  one  distribu¬ 
tional  change  across  any  given  portion  of  the  sequence 


we  are  examining,  a  partition  into  more  than  two  groups 
seems  likely  to  obscure  or  confound  the  detection  problem. 

If  we  confine  ourselves  to  two  blocks  of  observations, 
as  an  initial  attempt,  we  would  compare  the  first  m  obser¬ 
vations  to  the  next  m  observations  by  computing  the 
usual  x2  statistic  and  continue  successively  comparing 
the  Ith  block  of  m  observations  with  the  i+lst  block, 

1*2, 3,..  ••  Our  statistic  depends  on  i  and  m  and  in  the 
notation  developed  thus  far  becomes 


(17) 


V,  (i,m) 


r  (S^1!1^  -  S<*»>  )2 

r  ^  i  J  m  3  J 

W>  ♦  sj‘m) 


m,J 


m,J 


In  monitoring  ,  if  no  shift  occurred  during  trials 

im+1  to  i(ra+l)  we  expect  small,  otherwise  It  should  be 

large.  As  we  have  Indicated  previously  the  selection  of 

m  depends  on  r.  It  should  be  at  least  5r  to  discourage 

empty  cell  problems.  More  precisely  we  would  like  the 

expected  cell  frequencies  to  be  at  least  three  to  five. 

With  the  true  distributions  unknown  we  instead  suggest 

at  least  five.  Since  we  are  not  concerned  with  the 
r 

distribution  of  our  monitoring  index  we  might  drop  the 
denominator  from  and  simply  examine 


(18) 


V2(i,m) 


£  £  ( ( 1  +  1  )m) 
j=l  m»J 


(im) .? 
m,J  ;  • 


1 
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Another  strategy  which  is  an  adaptive  modification 
of  is  the  following.  If  V'1(l>m)  is  small  pool  the 
first  2m  observations  into  one  sample  and  compare  this 
group  with  the  third  block  of  m  observations.  More 
generally  this  idea  leads  to  a  comparison  of  the  first 
im  observations  with  the  next  set  of  m  observations  via 


(19) 


V3(i,m) 


r 

Z 

J-l 


(S 


(im) 

im^ 


i(S 


im,j 


i  s«l+l>n>,2 

m  J  J 


if  V^d.m),  V3(2,m), . .  .,V3(i-l,m)  are  small.  Again  the 
denominator  in  (19)  may  be  suppressed  using  instead 


(20) 


Vi,  U,m) 


Z  (S 

J=1 


(im) 

im,j 


i  s((i+l)m)j2 
m  >J 


All  of  these  statistics  suffer  one  drawback.  When 
a  distributional  change  occurs  it  will  occur  somewhere 
within  a  block  of  m  trials.  When  our  statistics  are 
computed  across  this  change  we  will  be  comparing  m  or  more 
observations  from  the  old  distribution  with  m  observa¬ 
tions  some  from  the  old  and  some  from  the  new.  But  the 
most  dramatic  difference  should  be  revealed  if  we  com¬ 
pare  the  m  trials  Just  prior  to  a  shift  with  the  m 
trials  Just  after  a  shift.  Moreover  we  would  prefer  a 
statistic  which  can  be  computed  at  successive  trials 
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(such  as  those  of  the  previous  sections)  rather  than  at 
every  mth  trial.  A  statistic  which  accomplishes  both 
these  objectives  is 


r  (SU2  -  SU~m))2 


<2i)  w^>  -  a  <:&  t&v 


m ,  J  m ,  J 


or  deleting  the  denominator 


(22) 


w  (l)  =  i  (s(iJ  -  s(^Tm))2, 

/  J  _2  m » J  m » J 


(Note  that  Wg  and  can  not  be  computed  any  sooner  than 
.£=*2m. ) 

In  observing  Wg  and  over  l  we  expect  them  to 
begin  to  Increase  at  £»k+l  peaking  near  £=*k-*-m  and  then 
decreasing  until  f*k+2m.  The  occurrence  of  a  spike  of 
thi3  sort  suggests  that  a  distributional  change  has 
occurred . 

Although  E( Wg)  is  rather  hopeless  to  compute, 

E(W^)  is  straightforwardly  obtained  directly  from  results 
after  (15) ,  1 .e. , 


E(W  7U))  -  1  K  (  fM  |  -  sltTm>)? 

I 


r.  [KC'.yj)2  ♦  -  2K(:?y  J  )i:(s(i7m))] 
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2m(m-l)Epj2  +  2m  -  2m2Epj2  if  l± k 

(k+m -l )  (k+m-t-1 )  EPj  2+  ( l- k )  U- k-1 )  Ip  j  2 

+2(k+m-£) (4-k)IPjPj+m(m-l )Epj2 
+2ra-2m(m+k—£ ) Ep^  2-2m(£-k) EpjPj 

if  k+l<£<k+m 

(k+m-£) (k+ra-i-1 ) EPj  2+(£-k) (i-k-1 )Ep^  2 
+2(k+m-£ ) (i-k)EPjPj+m(m-l)EPj2 
+2m-2m (m+k-£ ) Ep j Pj -2m ( £-k ) Ep j  2 

if  k+m<£<k+2m 


2m(m-l ) EPj  2+2m-2m2Epj  2  if  l>k+2m. 


After  simplification  these  expressions  become 

2m(l-  Pj2)  If  t±k 

(£-k)2E (Pj -Pj )2+(i-k)(Epj2-EPj  2 )+2m(l-Epj  2 ) 

if  k+l<£<k+m 

(k+m-£ ) 2E (Pj -Pj ) 2  +  (k+m-f ) ( Ep^  2-Epj )+2m( 1-Epj  ) 

if  k+m<f<k+2m 

2n(l-EPj2 )  if  f>k+2m. 
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Thus  as  with  our  previous  W  statistics,  F.(W^)  depends 

«  2  '  *  p 

on  p  and  p  only  through  Ip  ,  Ip  p  ,  and  Ip.  .  Moreover 
%  %  J  J  J  J 

E(W^)  depends  only  on  Ip^  2  if  £<k ,  only  on  Ip^ 2  if  £>k+2m. 

E(W j)  also  shows  that  may  be  expected  to  increase  and  then 
decrease  across  the  trials  k  to  k+2m. 

In  the  binomial  case  Wg  and  reduce  to 


2m  ( 


l 

Z 


l-  m 
I 


V*) 


x,  -  i  x.y 

i=*£-m+l  1  i*£-2m+l  1 


(2m  - 


X 

I 


X 

I 


x. ) (  I  X.) 

i=^-2m+l  1  i=£-2m+l  1 


£  £-m  - 

W  7(£)  -  2(  I  X  -  I  X,  )  . 

'  i=*£-m+l  1  i=«£-2m+l  1 

As  in  the  previous  sections  k=£Q  provides  an  estimator 

of  k. 

4 .  The  Results  of  a  Simulation  Study. 

An  extensive  simulation  study  was  undertaken  to 
compare  the  performance  of  the  7  W  and  4  V  statistics  under 
a  variety  of  circumstances.  Table  1  enumerates  10  of  the 
more  interesting  cases  examined.  A  total  of  300  trials  were 
run  for  each  case  with  k-150  and  blocks,  m,  of  20,  30, 

40  and  50.  The  r  values  3,  5,  and  7  were  selected  as  the 
likely  range  of  application.  The  distributions  were 
selected  such  that  for  some,  the  change  should  be  easy  to 
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discern  while  for  others,  it  should  be  more  difficult. 

They  also  reflect  an  assortment  of  different  combinations 

2  '  '2 
for  Epj  ,  EPjPj  »  and  Zpj  . 

We  will  comment  on  each  case  briefly  but  first  some 
general  observations  may  be  made. 

(i)  The  cases  revealed  the  crucial  dependence  of 
the  selection  of  m  based  on  r.  With  r=3,  m-20  or  30 
were  effective  while  with  r*7  m  at  least  ^0  and  usually 
50  was  necessary.  A  practical  rule  of  thumb  would  be  to 
take  m  at^  least  7  to  10  times  r  if  feasible. 

(ii)  In  all  cases  studied  var(W^)  was  much  smaller 
than  var(Wjj)  making  W^(£)  far  more  effective  than  W^Cf) 
in  revealing  a  pattern  of  distributional  shift  as  opposed 
to  random  variation. 

(ill)  Similarly  in  all  cases  studied  var(W2)  was  much 
smaller  than  varCW^)  making  W ^ (£)  more  effective  than 

w3 U). 

(iv)  None  of  the  V  statistics  worked  as  well  as 
either  Wg(£)  or  W^(£)  so  that  they  will  be  dispensed  with 
in  the  remaining  discussion. 

(v)  Wg(£)  and  W^(£)  never  failed  to  respond  to  a 
distributional  shift  but  occasionally  (in  rather  erratic 
data  sequences)  indicated  a  false  shift. 

(vl)  Because  the  W^,  W^  and  W,.  statistics  will 

3 

often  be  of  the  order  of  10  or  10  logarithms  were  taken 
to  r,ive  a  more  tractable  scale  and  to  more  clearly  reveal 
patterns . 
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Case  # 

H 

Distribution  before  change 
Distribution  after  change 

Zpj '»  £pjpr  Epj 

1 

3 

( .  6  , .  3 ,  •  1 ) 

( .1 , .6 , . 3) 

.46,  .27,  .46 

2 

3 

( •  5 ,  •  3 , .  2 ) 

( . 8 , .1 ,  .1 ) 

.38,  .45,  .66 

3 

3 

(.3, .3, .4) 

( .  6 , . 3  » .1 ) 

.34,  .31,  .46 

4 

3 

(.4, .4, .2) 

(.4, .2, .4) 

.36,  .32,  .36 

5 

5 

KyisSBB^Mi 

.32,  .19,  .32 

6 

5 

(.3,.2,.2,.l,.l) 

(.6, .2, .1,-06, .05) 

.22,  .255,  -415 

7 

5 

(.2, .2, .2, .2, .2) 

( .  4  , .  3 , .  1 , .  1 , .  1 ) 

.20,  .20,  .28 

8 

5 

EIISIIhH 

1HMBM  r 

.22,  .18,  .22 

9 

0 

(.4,.l,.l,.l,.l,.l,.l) 

(.1  ,.4,.l,.l,.l,.l,.l) 

.22,  .13,  .22 

10 

■ 

mm 

IWffnagmmBiai 

.16,  .18,  .23 

Table  1:  A  Sampling  of  Simulation  Cases  Studied 
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(vii )  W <-(£)  consistently  revealed  multiple  spikes 
over  i  thereby  clouding  the  perception  of  a  distributional 
change.  However  in  virtually  every  case  considered  its 
absolute  peak  was  within  5  trials  of  k+m/2. 

We  now  turn  to  the  individual  cases. 

Case  1:  This  should  be  an  easy  shift  to  detect.  Nonethe¬ 
less  W^  and  W2  were  ineffective  until  m=4o  and 
were  only  really  clear  at  m=50.  and  were 

reasonably  clear  throughout.  Wg  developed  a  more 
sharply  defined  unique  peak  with  increasing  m. 

Wg  and  Wy  were  excellent  even  at  m=20. 

Case  2:  Again  this  should  be  an  easy  shift  to  detect. 

and  W2  were  both  fairly  good  at  m=*20,  30.  By 
m=40,  50^W2  was  excellent  and  W1  quite  good. 
and  W^  were  ineffective  until  m=40.  W^  was 
erratic  but  absolute  peaks  were  always  correct. 

Wy  and  to  a  lesser  extent  Wg  were  bothered  by 
early  Idiosyncrasies  in  the  sequence  which  smoothed 
out  by  n=40. 

Case  3:  This  shift  should  be  a  bit  more  difficult  to  detect. 
W^  was  ineffective  even  at  m=50  although  W2  was 
good  by  m=40.  W^  was  better  than  W ^  although 
neither  was  really  sharp  until  m=50.  W^.  was 

fairly  clear  throughout.  Wg  and  Wy  were  both 
good  even  at  m=20. 
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Case  4:  This  is  clearly  the  most  difficult  to  detect  of 


Case  5: 


Case  6 


Case  7 


the  three-cell  cases  presented.  W  was  ineffective 
throughout.  was  only  effective  at  m=50. 

and  were  quite  good  particularly  by  m=4o. 

was  too  erratic  to  be  helpful.  Wg  and  were 
also  ineffective  for  each  m. 

This  shift,  analogous  to  case  1,  should  be  easy 
to  detect.  W,  was  not  effective  until  m=50. 
was  better  being  reasonably  clear  by  m=40. 
was  good  at  m=40  and  excellent  at  m=50  while 
never  responded.  W,-  was  fairly  clear  throughout. 

Wg  and  were  excellent  surprisingly  even  at 
m=20 . 

This  shift  analogous  to  case  2  should  also  be  easy 

to  detect.  Vi ^  was  excellent  throughout  with 

effective  at  m=4o.  and  were  also  ineffective 

until  m=40.  was  too  erratic  to  be  helpful. 

5 

Wg  was  fairly  clear  at  m=30  and  quite  good  at 

m=40,  50^  while  did  not  become  clear  until  50. 

As  in  case  2  both  Wg  and  seemed  somewhat 

bothered  by  early  idiosyncrasies  in  the  sequence. 

This  case  should  be  more  difficult  to  detect 

than  the  previous  two.  W^  is  excellent  by  m=40 

with  Wx  clear  by  m=50.  is  sharper  than  but 

both  are  good  by  m=4o.  Wg  is  fairly  clear 

throughout  .  Wr  and  W.,  both  detected  a  false 
o  ( 
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shift  at  £=100  which  smoothed  out  somewhat  but 
not  completely  by  m=50. 

Case  8:  This  case  analogous  to  case  4  is  clearly  the 

most  difficult  of  the  five  cell  cases  presented. 

never  responded  while  was  quite  good  at 
m=50.  Wjj  was  erratic  throughout  while  was 
marginally  effective  by  m=40.  was  quite  good 
throughout  giving  better  performance  relative  to 
the  other  statistics  than  in  previous  cases.  Wg 
and  Wy.  were  good  particularly  at  m=4o,  50. 

Case  9:  With  7  cells,  m=20  and  m=30  ought  not  work  well 
for  any  of  the  W*s.  Nonetheless  Wg  and  W^.  were 
excellent  by  m=30.  W.^.  was  poor  throughout  with 

W?  finally  becoming  reasonably  clear  by  m=50. 

and  were  poor  throughout  while  was  fairly 
good  throughout. 

Case  10:  This  case  should  be  much  more  difficult  than 

Case  9.  Nonetheless  and  were  both  quite 

good  by  m=40.  Also  W^  and  W^  were  effective  after 

m=40.  Wc  was  too  erratic  to  be  effective.  W„ 

5  7 

was  poor  throughout  with  Wg  a  bit  better  by  m=50. 

In  summary  from  the  methods  of  section  3.1, 
is  clearly  the  better  choice.  From  the  methods  of 
section  3-2,  W^(£)  is  the  best  choice  and  from  the  methods 
of  section  3*3,  Wg(£)  Is  the  best  choice.  Amongst  , 

W^ ,  and  Wg  it  is  not  possible  to  select  an  overall  best 
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choice.  All  three  should  be  effective  with  m  large  and 
all  three  can  be  monitored  concurrently  to  mutually  con¬ 
firm  a  detected  distribution  change. 
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